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Abstract 

A disordered spin glass model where both static and dynamical properties 
depend on macroscopic magnetizations is presented. These magnetizations 
interact via random couplings and, therefore, the typical quenched realization 
of the system exhibit a macroscopic frustration. The model is solved by using 
a revisited replica approach, and the broken symmetry solution turns out to 
coincide with the symmetric solution. Some dynamical aspects of the model 
are also discussed, showing how it could be a useful tool for describing some 
properties of real systems as, for example, natural ecosystems or human social 
systems. 
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I. INTRODUCTION 



Macroscopic frustration can be found in different domains, from interpersonal relation- 
ships to granular matter or natural ecosystems. All these systems are characterized by 
frustrated components with a thermodynamically macroscopic size. In other words, in all 
these systems, there are components whose size is comparable with that of the whole system 
and which underly to the action of opposite forces. The classical example is the case of a 
man A who desires to spend some time with a dear friend B, which, unfortunately, wants 
to bring his wife C, which is really detested by A. 

Dozen of examples can be found in nature. Consider the antler of a deer, it is known 
that it represents a frustrated phenotype. In fact, sexual selection tends to prefer its growth 
in order to increment the chance of reproduction but antler is an obstacle in some situa- 
tions, such a predator pursuit in a forest and, therefore, natural selection pressure is for its 
reduction. 

From a more strict physical point of view, systems which exhibit frustration are very 
common (see U for a general view). For a disordered spin system Toulouse has intro- 
duced the definition of frustration for an elementary plaquette of bonds, consisting in the 
product of the corresponding couplings. Nevertheless, systems where frustration appears on 
macroscopic scales are less ordinary and not yet investigated as far as we know. 

In this paper we present a spin glass model where spins are organized in macroscopic sets, 
with the corresponding macroscopic magnetizations interacting via random couplings. For 
a typical random realization of the couplings, the system is an ensemble of interacting frus- 
trated macroscopic entities and, therefore, it could be a natural candidate for mathematical 
modeling of phenomena where macroscopic frustration plays a central role. 

Let us briefly sum up the contents of the paper. 

In sect. II the model is introduced. The model becomes self- averaging when the number 
of components is large, nevertheless, some considerations about its finite size version are 
also written down. 
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In sect. Ill we look for a solution of the model using a revisited version of the replica 
trick. This revised version could be applied in a more general context to a large class of 
models, as it will be explained. 

In sect. IV and in sect. V, respectively, the replica symmetry solution and the broken 
symmetry solution a la Parisi are derived in detail. The two solutions turn out to coincide, 
vanishing the benefits that the Parisi ansatz has in other spin glass models. 

In sect. VI the symmetric solutions is studied in detail from a numerical point of view 
showing that, at variance with the S-K model, it keeps its physical meaning even at very 
low temperature. 

In sect. VII some final remarks are contained, in particular some dynamical aspects are 
illustrated. Dynamics could be a profitable argument of future investigations especially for 
its possible applications to ecosystems and natural selection modeling. 



II. THE MODEL 



Let us consider an Hamiltonian where N spins are divided in L sets, each set consisting of 
exactly M = N/L spins. Each spin interacts with all other spins, but the coupling does not 
depend on the sites of the spins, but only on the sets of the spins involved. In other words, 
two spins of different sets interact via a coupling which depends only on the coordinates 
of the two sets of membership. Then, we can speak of coupling between sets rather then 
between spins. We also assume that spins of the same set do not interact. 

This Hamiltonian can be written as 

H m ,l{J,o-) = ~ M ^j- ^2 J k,iVk(Ti , (1) 

where J is a N x N symmetric matrix, consisting of L 2 blocks of M 2 entries each, being M 
the linear size of a block. All the M 2 entries of a given block take the same value and, in 
particular, the diagonal blocks consist of null entries. The free energy of the system is 
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f M AJ) = -j^l^Y,eM-PH M , L {J,G)\ , (2) 

where the sum is intended over all the spin configurations. 

The thermodynamic limit iV — > oo can be obtained in two different ways since N is the 
product of two variables (N = LM). In fact, the limit L —>■ oo would mean to consider a 
system whose properties and characteristics are the same of those of the S-K model ||. On 
the contrary, the limit M — > oo leads to a mean field model with a macroscopic frustration. 
The self-average properties are obtained by also performing the limit L — > oo after the limit 
M — > oo. Nevertheless, non self-averaging macroscopic frustration also is exhibited for finite 
L as we will show later with an example. 

We thus perform the limit M — > oo, keeping L finite. After some algebra, the free energy 
reads 

f L (J) = --^maxr(J,m) , 

where m = (mi, . . . , mi), having defined the ith set magnetization as 
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and where 



r( J, m) = -y= Jijmtmj + ^ ®( m i) ■ (3) 

The indices i and j run over the spin sets, and J is now a symmetric L x L matrix, obtained 

from matrix in (|l|) substituting each block with a single entry, being J it j the value of the 

coupling connecting a spin of set % with a spin of set j, with J^j = Vi. Furthermore, $(m;) 

represents the entropic term of spin set i 

1+rrii 1 + rrii 1-771*1-771* 
<P ( m,- = m In 
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Let us suppose that the non diagonal elements of J are independent identically dis- 
tributed random quenched variables. For the sake of simplicity, we restrict ourselves to 
consider normal Gaussian variables with vanishing average and unitary variance. Our aim 
is to compute the quenched free energy 



/ = lim f L (J) = - lim — maxr(J, m) , (4) 

where the last equality is due to the self-averaging property of the free energy which holds 
in the large L limit. The max in ([3j) is reached for m* = (m*, . . . ,m* L ), which obey to the 
following L self-consistent equations 

1 < % < L . (5) 

We consider the large L limit, because we have in mind a system with many macroscopic 
frustrated components, nevertheless the glassy characteristics (except self-averaging) can be 
also found for finite L. Consider, for instance L = 3 with the product of the three couplings 
with negative sign. At low temperature (temperature below transition, not vanishing!) the 
system is degenerated since it has six different pure states with the same free energy and 
with non trivial and non all equal values of the three magnetizations involved. 

When L increases, frustration increases and also the number of pure states corresponding 
to the same free energy. We hope to find in this way an interesting spin glass model with 
new peculiarities. 

III. REPLICA TRICK REVISITED 



In order to perform the limit L —>■ oo we need to compute max m r(J, m). We will 
accomplish this task by means of replica trick with a slight but crucial variant. Let us stress 
from the beginning that this way of applying replica trick is not restricted to our model, but 
it is more general and, in principle, could be of some help in solving many other models with 
macroscopic variables. In fact, what we propose here is a useful technique for computing 
quantities of the type max m T(J, m), i.e. an average whose argument is a maximum over an 
expression which depends on random variables (J) and on variables to be maximized (m). 

It is easy to check that 

maxlYJ, m) = lim lim — In 
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tanh 



JL 
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dmexp (/ir(J, m)) 



(6) 



where dm = fli drrii. In fact, after having performed the limit n — > as in ordinary replica 
trick in right hand side of (|]), the saddle point method allows to compute the limit \i — > oo, 
giving equality (||). The variable // is here only an auxiliary one. 

Making explicit the n replicas, the average in right hand site of (H) can be written as 



J dmexp ([iT(J, m)) = J dm a exp G n (fi, m 1 , . . . , m n ) 



having defined 



G n (fi, m 1 ,.--,™") = In exp^2fiT(J,m a ) , 



where the index a runs over the n replicas. Finally this leads to the following expression for 
the free energy / 

f = — lim lim lim — In / TT dm a exp G n (u, m 1 , . . . , m n ) . (7) 

J L^aoi+^oonr-o pLfm J V" v y w 

In our case, taking in mind equation (H), we can give an explicit expression for G n . For 
the sake of simplicity we do not write in the following the argument of G n . After have taking 
the averages over the Gaussian J variables, and after some algebra, one has 

°n = ^f E(E«') 2 + ^E^«) , 

' i in 

a,a 1 

where a and a run over the replicas, and where terms not diverging with L have been 
neglected since they would disappear in the successive limit L — > oo. By means of the 
parabolic maximum trick, the above expression can be rewritten as 



G n = max 



where {? aa '} is a n x n matrix, which represents from a physical point of view the overlap 
between replicas in spin glass theory. 

Now the integral in (|7]) can be fully factorized among the different spin sets, individuated 
by the index i. This fact allows us to perform the limit L — > oo which gives the final 
expression for the free energy in the replica context: 
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f = — max lim lim — — In / TT dm a exp G„ 



(8) 



with 



H 2 P 



G r , 



m 



where now m 1 , . . . ,m n are n replicas of a scalar magnetization. Notice that interchange of 
the position between the maxr„ ,\ and the integration is allowed since in the limit L — > oo 
this maximum corresponds to a saddle point approximation of an integration with respect 
to the same variables {q aa '}- 

IV. REPLICA SYMMETRIC SOLUTION 



In order to find a solution, i.e. to compute the quenched free energy (|8|), we start by 
trying the usual symmetry unbroken strategy. Let us stress that the diagonal terms of 
matrix q are relevant for this model, at variance with the celebrated replica solution of the 
S-K model 0. Therefore, in spite of assuming that the diagonal terms vanish as in symmetry 



unbroken solution of S-K, we assume 



x . 



where 5 a a > is the Kroeneker delta. Notice that elements on the diagonal differ only for 
a quantity of the order of from the other entries, otherwise one would have diverging 
terms in the limit \x — > oo. This fact implies that overlap turns out to be a constant only 
once the limit /x — > oo has been performed. With this choice one gets 

,2/32 / \ 2 



Gr. 



where terms which vanish in the two limits n — > and /i —>■ oo have been neglected. By 
means of the standard Gaussian trick we have 

\ 21 / \ 



exp 



m 



exp (jiPujy/qJ2 



m 



(9) 



where the average () is on an independent normal Gaussian variable u. The above equality 
allows for writing 



exp G n = ( Y[ ex P [if3uo^/qm a + 



m a Y -q)+ /i$(m Q ) 



Notice that the argument inside the () average in the previous expression is fully factor- 
ized among the n replicas. For this reason the integral in (|8]) becomes the nth power of a 
single integral, and therefore the limit n — > can be performed: 



f = — max lim — - ( In / dm exp 

q,x fi-*°° fip \ J 



q) + «$(m) 



Finally, the limit u — > oo can be performed by means of the saddle point technique, obtaining 



max ( max 

q,x \ m 



X 
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i/qm+ |(m 2 - q) 







(10) 



Let us stress once again the important role played by the small symmetry breaking (non 
vanishing x) introduced in the overlap. In fact, if we fix x = choosing in this way a 
pure unbroken solution, the extremization with respect to q would be impossible, since the 
argument in (|1(J) would diverge for q — > oo. It also should be noticed that at least one of 
the maximum with respect to q and x could has become a minimum after having performed 
the limit n — ► 0. 



V. FAILURE OF BREAKING 



Trying to apply the ordinary approach to spin glass models, the following step consists 

in introducing an asymmetry in the overlap matrix. Assume now that 

x y 
a i — a H o i H t ' . 

qa ' a Pn a ' a fin 

Following Parisi parameterization 7 aa ' is a matrix whose entries vanish except inn// 

quadratic blocks of I 2 elements along the diagonal, where all entries are equal one. Notice 
that we have made explicit once again a factor u _1 , otherwise we would have divergent 
terms. In this case the maximum has to be taken with respect to q,x,y and I. 
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With this ansatz and neglecting terms vanishing in the successive limits n — > and 
p — > oo, G n turns out to be 

,2/32 / \ 2 



l^-L ^3 X r — 



™°) 2 -,) + ^E 



where the index k runs over the n/l blocks on the diagonal of 7 Qa ' and the sum on a G k 
goes on the I values of a corresponding to the kth block. 

By means of the parabolic maximum trick it is possible to write 

fi/3y 



^2 mC 



max 

pk 



vPy pk 



m 



Pk 



In this way, repeating also the trick in (H), we have factorized G n with respect to the n/l 
blocks, and, therefore, the limit n — > can be performed. One gets 



f = — max lim — — (in f TT dm a maxG, 
q,x,y,l M-oc \ J 11 P 



(11) 



with 

Gn 



E 



p(3u^m a + ^ ((m a ) 2 -q) + s/pTv p m a - P - ^ 



ppy 



ql + p§(m a ) 



where now the index a runs over only a single block, whose corresponds the scalar variable 
p, and where () means the average over the normal Gaussian u. 

The maXp in ( |TTD can be put outside the integration. This change is allowed and can be 
understood by the same argument used after equation @. As a consequence, the integral 
in the previous expression is factorized among the I replicas of a block, and reduces to a 
single integral because of the factor I in the denominator. Moreover, this integral can be 
computed by means of the saddle point method in the limit p. — > oo, obtaining 

nPx. 2 \ . r~r p 2 pfiy 

pfJu^/qm + — -(m - q) + \J pfiy pm- — 



f = — max lim — - ( max 

q,x,y,l P-"x> pfj \ p,m 



-ql + jJL^{m) 



2 v V r, » r 2[ 2 

The maximum with respect to p can be computed, and then performing the limit p — ► oo 
one finally has 



f — — max ( max 

q,x,v,i \ m 



u)y/qm + 



x + yl 



[m 



q) + p$(m) 



Unfortunately, this final result is exactly the same of the unbroken case (fLOf), the only 
difference being that the variable x is substituted by x + yl, which is irrelevant when the 
maximum is taken. 

This result could imply that the model simply has a constant overlap which depends only 
on the temperature; otherwise one should admit that the Parisi ansatz for replica symmetry 
breaking is inappropriate in this context. 

VI. UNDERSTANDING REPLICA SYMMETRIC SOLUTION 

The unlucky result of the replica broken solution allows us to suppose that the symmetric 
solution (|ToD could be the exact solution of the model. For this reason we have to study it 
in detail in order to get more evidences for supporting this hypothesis. 

The extremization with respect to q, x and m (this last inside the average and, therefore, 
for any different lj) leads to a system of self-consistent equations: 

= taiah.((3y/q~uj + (3xm w ) 
q=(ml) (12) 
x = 4= ( 10 m u ) 

this system of equations is solved by q*, x* and m* and the free energy may be written as 

/ = -*v - \ ( *«) ) 

Let us stress that q* corresponds to a maximum with respect to q while the limit n — > has 
transformed x* in a minimum with respect to x. 

For a given u, the first equations (|l^) which refer to the could have a single solution (a 
maximum) or three different solutions, depending on the temperature. At low temperature 
we have a single solution for uj > x/sfq and three solutions for u < x/y/q. Two of these 
correspond to a maximum and the third to a minimum, and this introduce an element 
of uncertainty. We follow the rule of taking the solution m* of the first equation which 
corresponds to the larger of the two maxima for every given u. 
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In fig. 1 we plot the overlap q* and the parameter x* as functions of the temperature 
T = 1/(3. The spin glass transition occurs at the critical temperature T c = 2, the same of 
the S-K model. 

In fig. 2 the free energy / and the entropy S = ( $(m*) ) are plotted as functions of the 
temperature T. At T = the free energy is / = y2/n ~ 0.798, which is very close to the 
value of the S-K symmetric solution. On the contrary, the entropy simply vanishes at T = 
at variance with the S-K case, where the negative entropy proves the unphysical nature of 
the solution in that case. 

Let us stress that how to take the right extreme point with respect to q, x and m is a 
crucial step of the solution, and our choice, previously described, could be inappropriate. In 
fact, with the limit n — > the maximum with respect to x has become a minimum, and this 
could also has happened for some of the m w . In this case one should look for the minimum 
with respect to the m u (or for the second maximum), at least for a subset of u. Indeed, at 
this stage, we are not able to give a sure answer on this point, which should be argument of 
future deep investigations. 



VII. CONCLUSIONS 



A dynamical approach to our spin glass model could be of some help in deciding for the 
correct solution. Following equation ([5]), the deterministic dynamics of L magnetizations is 



rriiit + 1) = tanh 



1< i < L 



Let us remind that matrix J has vanishing diagonal entries = 0, so that at each step 
the new value of the individual magnetization mj does not depend on its previous one. 
The above dynamics takes advantage of peculiar features. For instance, at each updating 
it moves m, in a value corresponding to a minimum free energy with respect to rrti itself 
keeping fixed the other magnetizations. Moreover, the free energy always decreases at each 
updating of a single magnetization. 
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The dynamics makes the system evolve toward a fixed point, which is a relative minimum 
of the free energy (not, in general, a global minimum). Repeating many times this evolu- 
tion, starting from different initial values for the magnetizations, allows to find the global 
minimum corresponding to the solution of the static spin glass model. Preliminary results 
seem to suggest that the theoretical symmetric solution of section VI is slightly different 
from dynamic solution only for very low temperatures. This not necessarily implies that 
the symmetric solution is not the correct one. In fact, in order to avoid finite size effects, 
one has to deal with large lattices (large L) in numerical simulations, so that the basin of 
attraction of the global minimum tends reasonably to become so small that one never uses 
correct initial conditions in spite of the large number of attempts. 

The above mentioned features make such a dynamics for magnetization versatile and very 
fast from a numerical point of view. Furthermore, not only it is useful for understanding the 
associated static model, but it is also interesting in itself. In fact, it describes a dynamical 
system which monotonically relaxes towards a stable point corresponding to a local minimum 
of the free energy. 

For this reason it is the ideal candidate for modelizing some complex systems, such as 
natural ecosystems, where each agent or species try to maximize its own fitness in a given 
context of other active agents. The fitness corresponds to the individual free energy with 
changed sign (the part of the free energy which depends on a given magnetization to*), 
and the magnetization m 8 to the species degree of specialization. The individual attempts 
to improve its own condition and it happens to push the whole systems to maximize the 
total fitness. This is the very peculiar feature of many real systems which is reproduced 
by our dynamical model, which also exhibit other realistic peculiarities, such as the fact 
that the phase space is a landscape of a large number of local maxima of the fitness at low 
temperature. In case of catastrophe (even a small change of the couplings) the system is not 
anymore in a state of maximal fitness and the evolution restarts towards a different local 
maximum (a new period of stability in evolution story), which is not necessary higher than 
the previous. 
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In conclusion, this model seems to be very versatile, since its dynamics could become 
both a powerful benchmark where to test general hypothesis about spin glasses, and a 
paradigmatic model for evolving complex systems. 
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